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ABSTRACT^ ' 

Following their first year of advance 
samples of students were polled. Study one analyzed t 
i| ,2i4^studne ts toward the admissj.on test they had tak 
Record Examinations (ORE), Lav School Admission Test 
College- Admission Test ( MC AT ), Admission Test for Gra 
Business; or the Millfer Analogies Test^^The relation 
attitud^es to field of study was also examined. Data f 
national sam,ple were analyzed by^ethnic group — there 
whites, 87 orientals, an 128 blacks. Overall, blacks 
most critical — 96% believed the tests were oriented t 
midJlerclass culture. Surprisingly, attitudes toward 
unrelated .to, graduate or undergraduate grades. Nearly 
tron both studies were critical. Students disputed te 
well the test represented their educational experienc 
(its relation to the real field of work) and coverage 
measure success factors such as creativity, academic 
interpersonal skills). Finally, students were concern 
tests and the testing organizations have too much pow 
conclusion, the role of admissions t^st as only one £ 
predicting academic success should be emphasize.d; nev 
criticisms should stimulate research into the meaning 
competence. (CP) 
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Testing has been the subject of controversy for' 
n\an\ vears particularly testing for admissions to 
eoucationai institutions Strong opinions have been 
" offered concerning tests appropriateness, accu- 
racv validity, and social functions Unfortunately, 
the recent controversy between pro-testing and 
anti-testmg groups has generated mui:h more heat 
than light It is easy to understand how the 
discussion could become mte?ise and polemical, 
■ because many people believe that admission tests 
are determinants of students' educational progress 
througfiout therr careers in,higl^er education They 
think that tests play the dominant tdle^ in determm- 
ing the students' admission to college. -the college 
ihe\ may attend, admissjon to gralduate or profes- 
( ^sional school and the quality of khe schools the 
students may attend , 

Considering the controversy concerning tests and 
their assumed importance, it is striking that there is 
* so little information aboi)t what the students who 
are required to take the tests think of them The 
Russell Sage studies (Brim, et a! , 1969. Gosim, 
1963 1967) provided some information about 
people's general opinions about tests, including the 
facts that the majority of secondary school students 
did not believe it fair to use intelligence tests to 
decide upon eligibility jor certain colleges, and that 
the majority of those who had taken college 
entrance tests felt nervous, lacked confidence, and 
did not'enjoy the experience Using another 
a[)f)roaf.h, Fiske (1^967) examined the reactions of a 
national sarr^ple of adults to six simulated tests The 
majority of respondents felt comfortable with a 
sirr^ulated intelligence test However, when they 
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were asked abocrt their reactions to the last "real" 
test they h'ad ^^tually taken, the majority of those 
who remembered a test for admission to school or 
college said they felt anxious and tensa Tesser and 
Leidy (1968) polled a large sample of hign school 
students for their opinions of tests The majority felt 
that tests were equally fair to all racial groups and 
that It \A/%s fair. that colleges base admission oh 
standardized test scores However, the students felt 
that colleges should place less emphasis on tests 
and place more emphasis on references and inter- 
views 

Although these studies have provided some 
useful information, none has explored the detailed 
reactions and views of students who are required to 
take tests for admission to educational institutions 
In this study, we examined students' views of the 
tests theyVmust take for admission to grajduate 
departments, law schools, medical schools, busi- 
ness schools, and other professional schools The 
reactions of students to^these tests are especially 
relevant to the controversy concerning tests in two 
ways first, the tests do play a large role m admission 
to some fields, second, the students who take these 
tests are well educated, academically oriented, and 
have^given thoughful consideration to the issues, 
involved 

We therefore^sought information about graduate 
and professional school students" feelings about the 
admissiop6 ^ests they had taken by p'olling two 
samples of students who were at the end of their 
first year^Qf advanced study The relation of these 
attitudes to field of study, academic success, and 
ethnic group status was also examined 

Study One 

The'data for this study comes fr6m a follow- up of a 
-survey of a national sample of college seniors who 
replied in the spring of*1 971 to a questionnaire.Jhe 
College Senior Survey (Baird, 1974) Some 7734 
former seniors who had attended 94 colleges across 
the country respondeji, in late spring of 1972, to a 
follow-up questionnaire designed to determine their 
activities a year after college (This represented 
aoproximately 70% of those sent a questionnaire ) 
Analyses indicated that the sample includedpropor- 
tionately fewer minority students than did the 
nonrespondents, but the sample did hot seem to be 
biased in any other way, andjncluded an extremely 
wide variety of students. The Senior Survey included 
a gi^eat deal of biographical, attitudihal and educa- 
'tionaf information about students Repofts "of the 
Graduate Record Examinations (GRE), Law School 
Admissions Test (LSAT), and Medical College 
Admissions Test (MCAT) scoresof students vvho had 
taken tftose testswere also obtained The follow-up 
qljestionnaire ascertained students' educational 
and vocational activities Due to the questionnaire 
design, only the 4,248 students currently attending 
graduate or professrorral school were asked their 
^-^--mions about the tests 



Overall, the results of the analysis of the follow-up 
sample shqwn in Table 1 indicate that only 45% of 
the test takers felt that the graduate or professional 
admission test they had taken had accurately 
assessed their abilities, although 57°o felt the tests 
assessed abilities that are relevant to success inthe 
field, and 64°o felt.the tests to be fairly comprehen- 
sive in th^ir coverage They did not feel that the tests 
were inferior to written essay type exams (only 39 
percent felt essay tests were better) They felt that 
the test was primarily an obstacle to admissions 
rather than a help to the candidate (55 percent) 
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/ / • Table 1 

/ Tests Graduate and Professional School Students 
/ / Have Taken and Their Attitudes Toward Them' 
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1 Scores are reported in percentages 

2 Agree figures are calculated on the basis of the number of students who had taken an admissions tests. 



Perhaps partly because of these attitudes, half of the 
students tended to feel the test made them nervous 
while they were taking it (50 percent). About half (49 
percent) felt the tests had not provided enough time 
to adequately assess their capabilities. Finally, 61 
percent felt tha^t the content of the tests was 
oriented toward the white, middle-class culture 
while 41 percent felt it was biased against blacks 
and other minorities. > 

Whervth'e results were analyzed by fields, they 
revealed some large differences. For example, only 
35 perfcent of the arts and humanities students who 
had' taken the GRE felt that the testjy^ccurately 
assessed their abiliti^ m jcontrast to 58*percent df 
^ law students who took the LSAT..Social science 
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Students and law students often reported feeling 
. nervous while taking the test (57 and 58 percent 
respectively), arts and humanities students (39 
percent) and physical science and engineering 
students (42. percent) were nervous less often. The 
phrysical science students were the least likely to 
fpel that the GRE was biased against blacks (26 
percent), social science students were the most 
* likely to believe the GRE was biased (60 percent). 

Study Two 

The data from a second national sample of 
graduate and professional school students was 
analyzq.d by the^ethniCgroup in which the students 



placed thenselves. black, oriental, and white ^ 
Overall, blacks were clearly the most critical of the 
tests and orientals were the most favorable (There 
were 2,036 whites, 87 orientals, and 1 28 blacks in 
this sample.) The largest differences were on four 
items, two of which dealt with bias. The four items, 
follpwed by the percentages of blacks, orientals, and 
whites, respectively, who agreed wjth the item were 
as follows. "Content is oriented toward white, 
middle-clas^s culture' (96, 58, 67), "Content is 
biased agair^st blacks and other minorities" (87, 41, 
^50); "Accurately assessed my abilities" ([24, 56;>5l); 
and "Is primarily an obstacle to admission rather 
than a help to the candidate" (80, 48, 55). Perhaps 
the best way to summarize these results is thai the 
oriental students were the least negative toward the 
tests, the blacks considered the, test^ as biased 
obstacles to admissfon and the vyhites were in the 
middle, although many of them were critical of the 
tests. 

Contrary to what many people would*' expect, 
altitudes toward tests" were virtually unrelated to 
students' undergraduate or graduate grades They 
were also generally unrelated to students' admis- 
sions tesj scores (no correlation between any test 
and opinion about tests was as high as 15) 
Students' opinions about tests were also generally 
unrelated t^ their opinions about other areas of 
graduate or professional school , 

The results I have reported so far suggest that 
students hold divided opinions about tests Evidence, 
for the importance of the role of testing in students' 
thinking lies inth^fact^that nootherquestionsinthe 
surveys elicited as much student comment as the 
questions on attitude^ towards tests. (The survey 
covered almost all aspects of graduate and profes- 
sional education - surely enough to comm^ent on.) 
The comments were nearly all cnticaljoonedegree 
or another. At best, the tests were seen as a 
necessary evil, at worst, tests were seen as the 
direct cause of all personal and social problems. The^ 
following comments illustrate the mam themes. 
Mahy students \K/ere simply negative, m a humorous 
way. 

I do not believe the LSATI^^i/aliiil^g^g 
instrument to determine ability to compre- 
hend the' study of law. In my own instance I 
received a 464 on the LSAT but at the 
present I rank 2nd of 140 in my class! I rest 
my case! 

Other students were humorless. 

The GRE is a pile of ! 

\ 



•In addition<to the sample just described, an additional sample of first 
year graduate and professional school students was obtained m 
selected fields This sample was to be used to allow certain analyses in 
the fields of Law, Medicine, Chemistry, Biology, English. History, 
Economics, and Psychology Some 2474 'students from 105 
departments and sqhoolscompleted the same survey used m the foHow- 
O 3f Jtie senior sample 



The MCAT was the stupidest standardized 
test I've ever \een, except, perhaps the 
science sectionAThe math was villainous, 
easrer than sAt's. The $20 fee was 
ABSOLUTELY )pUTRAGEOUS FOR 
THIS PIECE OF GARBAGE. 

Most criticism was mcich milder and well consi- 
dered. Some o,f the most thoughtful criticism 
concerned the content and\:overage of the test, two 
areas in which the testing\prganizations place a 
great^deal of effort/ X 

Re the GRE The test provides a fairly 
accurate assessment of s\me abilities 
relevant to success in graduate study; viz. 
reading speed and compreherrfeion, some 
vocabulary, simple afgebraic Vianipula- 
tions, interpretation of graphs ancKcharts. 
However, (1) since I. have found thaW:ie 
' quantity of material which must be stuoie&\^ 
• m most graduate courses is not great, I fee! 
that both sections of the exam are toc^ 
speeded. (Of course, portions of the mathV 
section in particular are sa3imple that they 
must be speeded in order to produce much ^ 
variation in the scores.) And (2) the math 
section IS not comprehensive in coverage. 
Nothing is required in the way of the 
production, or at least the understanding, 
of mathematical or logical proofs. The 
production or understanding of logical 
sequences of thought is usually necessary 
inthe writing or reading of research papers 

In response to these points, it should be pointed 
"out that the quantitative sectionof the GRE Aptitude 
test IS designed Jo assess the general {quantitative 
sl^ills and level of mathematical understanding 
among students representing a wide range of ability. 
Needless to say, rpost studentsdo not find the test at 
all Simple The^ kinds of questions suggested by the 
student just quoted are asl<ed on the Mathematics 
Advanced test, vvhich is designed to assess the 
.achievement ^qf students concentrating' in mathe- 
matics. 



I do not believe the MCAT is accurat^ as a 
gauge for sl<ills necessary to complete 
medical school. This belief is based on the 
fact that the MCAT tests specific facts. I 
cannot believe that the specific facts which 
It tests for are necessary for success as a 
physician. 

.It should be noted that lumping three 
sciences together in aoe test does not serve 
the purpose of testing a science major about 
his particular field: a student wrth a major in 
chemistry has not necessarily had much 
biology at aH. Hence a single test which 



includes a mish-mash of biology and 
chemistry cannot adequately determinethe 
chemistry major's ability to learn the 
chemistry material which was presented to 
him in his undergraduate courses 

The idea behind the MCAT is that it assess broad 
understanding of the areas of knowledge needed in 
medical school. The' MCAT attempts to use the 
testing time available to assess a variety of 
fundamental skills rather than achievement in 
specific subject areas. (More on the coverage of the 
test will follow.) 



In addition to comments about the inadequacies 
students felt they saw in academic areas covered by 
the tests,, many students commented about the 
important abilities the tests, did not cover The most 
Commonly mentioned unassessed ability was crea- 
tivity 

I feel emphatically, that aside from the 
absurdity of having to pay for taking such a 
test, It tests one and only, one type of 
intellectual ability the "obsessive compul- 
sive" and overly intellectualism and cere- 
bral ability [Sic] This test does not in any - 
way account k)r a person's level of cfeativi- ^ . 
ty and imagination, rather by virtue of the 
type of intellectual skills it calls into.play, it 
discriminaj^ against the above mentioned 
^gkills,^^^^ test IS an "outgrowth of white, 
mi36\e'C\ass society and I am hopeful that 
the current policy that many universities 
have in disregarding a person's scores or 
* even better not requiring them for admis- 
sion, will continue in a much more massive, 
widespread and dramatic way. 

There is no evidence that the aptitude tests 
necessarily discriminate against the creative per- 
son They are merely testing something different. Of 
course, the fact that good ^measures of creative 
ability are lacking means that graduate admissions 
committees have no toolstoassess creativity among 
applicants Consequently, admissions decisions are 
made largely on the basis of academic abiljty alone 



Another frequently mentioned "missing ability" 
was academic motivation. 

^Although entrance'" tests for graduate 
' school may give a reasonable assessment 
of a student's ability range, they do not 
aitempt to ellicit any information regarding 
the prospective student's mental attitude 
towards'graduate study Although I don't 
know how toMncorporate a reliable mea- 
O surement of motivation into entrance 
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exams, I do feel that student motivation is a 
prime importance m successfully pursuing 
a course of graduate study. 

Another frequently mentioned quality was skill in 
interpersonal relations. 



Too much emphasis is placed on the 
standard law school exam. This exam is 
generally the only, determination and 
measure of on^'s ability in law school. The 
standard exam doesn't measure such 
fissential legal skills asoral ability, negotia- 
tion skills, how one works when not under 
the pressure of a time limit, and abilities to 
work with people. 

• The testing programs recognize the fact that their 
tests do not, an'd probably cannot, measure motiva- 
tion, interpersonal skill, creativity, and many other 
qualities which are necessary for success. As the 
testing programs point out in their brochures, the 
tests' purposes are limited to assessing academic 
potential, and one should not read more into the 
tests than they can really offer Unfortunately many 
students and admissions committee members do 
not read these brochures, and ngany read too much 

"into the test scores 

♦ * ♦ 

Finally, many students expressed their concern 
' ' that testes, testing, and testing organizations have 
much too much power in our society. 

We are living in a test society. I think it is 
unfortunate that we must rely so heavily on 
tests- It would be a pleasant change to be 
admitted into something, besides prisoci, 
without first having to take an 8 hour test 
that boi/es you, fatigues you, and really 
. doesn't itest anyihing but your endurance. 
' ^My real feelings on the LSAT are that it 
measur/es speed ratherthancompet^ceor 
ability.;' I ^detest any educational admis- 
sions 'system which, in attempting to 
measu,re potential, actually thwarts and 
inhibits achievement by stifling ambition 
and opportunities on the basis of a four or 
eight hour test The perceptive test-taker 
may or may not beThe best lawyer, but he 
J will soon be the only type of individual 
admitted to law schools. 

My point \s that a process whereby 
students are cvjiled before they have had a 
chance to prove? themselves cannot satis- 
^ factorily serve Nthe needs or goals of 
education in a' (democratic society. The 
/reason is that an a\istocracy of test-takers 
dd^s not approximate an aristocracy of 
'merit or ability, and salorrg as standardized 
tests play a decisive role in admissions 
/ policies, equjal educ^ional opportunity for 
all vvill remain a myth. Of course, even the 
' most democratic of systems could not avoid 
frustrated ambitions, but it would not set 
artificial barriers such as minimum LSAT 
scores in the path of individual achieve- 
O ment 




In an ideal world, every person would be able to 
"try out" for every position in society. Thus, every 
student interested in medicine could attend medical 
school until flunking out Everyone whg^elieves he^ 
or she has the talent for a Ph.D. could stay in 
graduate school until they were askod to leave. 
Clearly, this arrangement would be extraordinarily 
costly and, in a real sense, unfair to many people 
who would waste years of theirtimebefore learning 
they did rjot have the capability to enter the 
profession ttjey hoped to^Dursue 

Many other students seemed to dispute the 
coverage of the tests; e.g , students objected to what 
they felt was the undue emphasis on Freudian' 
theory or statistics in the GRE psychology examina- 
tion, or the emphasis on the Civil War in the GRE- 
History test, or the emphasis on chemistry in the 
MCAT. The specific educational experiences of 
these students did not itiatch the specific questions 
included in these tests. It is important to realfze that 
each test is constructed to provide comprehensive 
assessment For example, each GRE Advanced Test 
IS put together with the active advice of committees 
of faculty members, from the disciplines. These 
faculty represent a wide variety of institutions and 
specialties. They work out the general categories of 
knowledge and skill which are important in their 
discipline, then agree on the relative weight - and 
the number of questions - which should be placed 
on each category in the examin^tion.*This helps to 
insure that the content of the examination reflects 
what IS currently being taught \n roost institutions 
and what is considered most essential in each field. 

^ To further help keep The tests up-to-date with the 
fields, new members are periodically added to the 
committees, and old members rotated off. 

-The committee members determine the content 
and scope of the test and write the test questions. All 

\ questions proposed for the test are'^reviewed and 
revised as necessary, and the entire test is then 
reviewed and approved by the committees. Profes- 
sional subject-matter and measurement specialists 
provide information and advice about methods of 
test construction and assist jn the preparation of 
questions and tests. However, their chief role is to 
coordinate the work of the committees. Thus, 
although the tests cannot cover every aspect of each 
field, they are designed to cover the most important 
aspects of the fields with as mOch educational and 
psychometric skill as possible. 

It seemsi apparent that students have serious 
doubts about the validity and functions of tests for 
admission to advanced study. Although the students 
quoted are a minojity of the test takers, they 
illustrate the fact that many able, well educated 
people are skeptical about the tests on many 
grou nds. They doubt the ^fepresentativeness of tests' , 
content. Many students question the tests' validity 



or relation to the real work of the field! Many do not 
believe they are necessary The students did not 
seem to appreciate - or even acknowledge - the 
pains that have been taken to make their tests fair, 

* valid, and helpful 

It IS important to remember that the students in 
this sample were successful in entering graduate or 
professional school. The tests had not been barriers 
to the m, yet thfey still were quite critical of the tests 
Itjl^ems plausibje to think that their criticisms are 
only the tip of an icebetg of criticism which could be 
found among college and high^chool students. A 
sample of students who had taken the tests but had 
not ervtered advanced study would probably be even 
more critical of the tests. " ' 

Perhaps test constructors should provide better 
explanations of the construction and us^ of their 
tests Perhaps admissions committees could give 
students their rationales for requiring the tests. It is 
possible that students might feel lesscriticartoward 
the tests if these things were done However, many 
students may still have the feeling, based on their 
owp experiences, that admissions testsare measur- 
ii/g something that is only one of the many factors in 
success in their field, and a rather small factor at 
that Their feelings are consistent with a mass of 
evidence that indicates that academic ability has 
little relation to high level accomplishment and 
creativity (eg, Hoyt, 1965. Baird, 1976) A certain 
level of academic ability may be a necessary but by 
no means sufficient condition for success m 
advanced education and the careers^o which it 
leads. (Although the testing programs^have never 
denied that the characteristics fhey asse^ are only 
one element in professional success, thjscaveat has 
often been ignored by students and by many 
admissions committees ) 

However, the role of tests rn predic]ingthecrit"3ria 
of strictly academic preparation for professional 
roles needs to be explained frankly and thoroughly 
Gene rally, they are not-the most important factors in 
admission to advanced education, they are not 
nearly as important as the patterns of undergradu- 
ate grades (Burns, 1 970) Perhaps most important of 
all, they do not determine the course ofindividual's 
lives,, they are just one of many considerations used 
bv some schools, m some fields to assess some of 
the characteristics of their^applicants. Although the 
applicant must find a different school or a different 
field which will offer admission, there are still many 
options open, ^and the determined incjividual often 
will be able \Q pursue a successful career 

On the other hand, the criticisms from these well 
educated students - who wilhbe, although it is a 
hackneyed point, the leaders of tomorrow - should 
stimulate testers and test-constructors to ekamine 

* their basic assumptions, and to reconsider the 
emphases of their testing procedures. Surely the 
testing profession could give more attention to 
methods for assessing the variety of motivations of 
a" Je entering higher education, the level of 



potential indicated by real-life accomplishrnents, 
and the assessment of the talents and skills which 
are really needed for competent performance in a 
variety of professional capacities To their credit, the 
testing programs of the Graduate Record Examina- 
tions and the Law School Admissions Council are 
engaged in a wide variety of research to assess,, 
among other qualities, creative scientific thinking,, 
biographical antecedents of performance in ad- 
vanced study, cognitive style, and, most important, 
the definition of the uieaning of professional 
competence and the relationship between their 
tests and professional attainment (Carlson, 1976; 
Clark and Centra, 1 976, Frederiksen, Ward'& Kiefer, 
1 975, Hilton & Schrqder, 1 976; Witkin & Cox, 1 975). 
I would hold that research in these areas will add 
much more to our ability to assess the capacity of 
individuals than any further refinements ot^urre^it 
tests of academic aptitutde and achievement 
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f^l A Prescription to Alleviate Disappointment 



Q E D Sig (Complete) the Order Form Below 

You may recall that last year there was a special issue 
of J E M devoted to Test Bias Within one month of 
publication we sold out all available i^f^es even though 
we increased our printing order in^the meantime, 
hundreds of persons have written asking us for copies of 
this issue, which unfortunately, we had to turn down 
This disappointed many' But we, cjan alleviate this 
disappointment if we receive ^sufficient demand by 
reprinting this issue And, we'll be able to offer it at the 
regular rate of $4 00' 

Sometime in June, JEM will come out with another 
special issue devoted to latent trait models and the^ 
applicability to educational measurement This issue 
differs from typical articles on*such models inthat it is not 
highly symbolic, theoretical, and obfuscate The major 
concepts are explained clearly, and numerous practical 
examples are presented This issue is a must for all 
advanced measurement theory and research design 
courses At the special Dre-publication price, it is withm' 
the economic reach of students in these courses The 



issue contains the following papers Latent Trait Models 
and Their Use in the Analysis of Educational Test Data 
(Hambleton and Cook), Solving Measurement Problems 
with the Rasch Model (Wright), Practical Applications 
of (tern Characteristic Curve Theory (Lord), Item 
Characteristic Curve Solutions to Three Intractable 
Testing Problems (Marco), The National Referen^ce^ 
Scale for Reading. An Application of the Rasch Model 
(Rentz and Bashaw), and Tailored Testing: A Successful 
Application of Latent Trait Theory (Urry). 

Are you buying a "pig in a poke^" We don't think so! 
Although the latent trait models issue is twice as largeas 
the regular issue, we can offer" it at a special price 
PROVIDED we have sufficient pre-publication orders IF 
WE HAVE TO REPRINT THE ISSUE, THE COST WILL BE 
AT LEAST $7.00 FOR A SINGLE ISSUE" DON'T BE 
DISAPPOINTED' GUARANTEE YOURSELF AN EXTRA 
COPY AND YOUR STUDENTS A VALUABLE AND UP-TO- 
DATE PRACTICAL CONSIDERATION OF U\TENT TRAIT 
THEORY AT A REALISTIC PRICE' HOW? BY ORDERING IN 
ADVANCE! 
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' No Cost 
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100+ copies @ $4.00/copy 
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